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We consider off-equilibrium dynamics at the critical temperature in a class of glassy system. The 
off-equilibrium correlation and response functions obey a precise scaling form in the aging regime. 
The structure of the equilibrium replicated Gibbs free energy fixes the corresponding off- equilibrium 
scaling functions implicitly through two functional equations. The details of the model enter these 
equations only through the ratio u>2 jw\ of the cubic coefficients (proper vertexes) of the replicated 
Gibbs free energy. Therefore the off-equilibrium dynamical exponents are controlled by the very 
same parameter exponent A = wijw\ that determines equilibrium dynamics. We find approximate 
solutions to the equations and validate the theory by means of analytical computations and numerical 
simulations. 



I. INTRODUCTION 

The key property of glassy systems is the slowing 
down of the dynamics upon lowering the tempera- 
ture. This property makes their study so challeng- 
ing both in experiments and numerical simulations. 
Indeed equilibrium dynamics becomes increasingly 
slow approaching the critical temperature in such 
a way that the relaxation time exceeds the labora- 
tory time scale and the systems fall off-equilibrium. 
This effects has its counterpart in numerical sim- 
ulations where the dramatic increase of the equili- 
bration time at low temperature strongly constrains 
the maximal systems size that can be equilibrated 
resulting in huge finite-size effects. Therefore a sat- 
isfactory theory of glassy systems must be able to 
characterize their off-equilibrium dynamics. On the 
other hand many believe that the important theoret- 
ical advances made in the context of the statics and 
equilibrium dynamics of these systems are useful if 
not essential to understand their off-equilibrium dy- 
namics. In particular deep connections between off- 
equilibrium dynamics and statics have been obtained 
in the study of aging [1-3]. These studies focus on a 
non-trivial time-reparamctrization invariance of the 
problem that naturally leads to a parametric (i.e. 
without the time) representation of two-time quanti- 
ties. In this framework, the problem of the approach 
to equilibrium of one-time quantities, say the energy, 
remains open. 

It would be natural to expect that, unlike the 
rcparametrization-invariant quantities, the corre- 
sponding dynamical exponents cannot be expressed 
solely in terms of quantities obtained from the stat- 
ics. We will show it is possible to obtain precise 
results for the dynamical exponents extending some 



results obtained recently in the context of critical 
equilibrium dynamics [4, 5]. In this paper we ad- 
dress the computation of the dynamical exponents 
for a class of glassy systems at the critical tempera- 
ture in a mean field theory framework. 

The order parameter in glassy systems is typi- 
cally a two-point function. In mean-field spin-glasses 
(SG) one considers the spin-spin correlation defined 
as: 

i N 

c(m)-^E< s *(^( s )> (!) 
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where N is the total number of spins in the system, 
the angle brackets mean thermal averages and the 
overline means average with respect to the quenched 
disorder [6]. At the critical temperature the equi- 
librium spin-spin correlation in zero external field 
exhibits a power-law decay in time, i.e. 

C(r) cx 1 (2) 

for large values of r = \t — s\ [7]. 

In [4, 5] it has been argued that this behavior fol- 
lows from the fact that the replicated Gibbs free en- 
ergy admits the following expansion near the critical 
temperature T w T c : 

G(Q) = £ <& - T TrQ3 - f E <& 

a, b a.b 

(3) 

where ax is some model-dependent constant and Q a i, 
is a replicated version of the two-point order pa- 
rameter. Furthermore it has been shown that the 
so-called parameter exponent A which determines v 



2 



through the following relationship: 

is equal to the ratio between the effective coupling 
constants w 2 and W\: 

A=^- (5) 

The fact that equilibrium dynamics follows from 
the static replicated Gibbs free energy makes it 
rather universal. Indeed, in the Landau sense, one 
can argue that the structure of the Gibbs free en- 
ergy near the transition depends solely on the sym- 
metries of the problem and therefore could be the 
same for quite different models. Notable examples 
of models whose replicated Gibbs Free energy ad- 
mits the expansion (3) near the critical temperature 
are the Sherrington-Kirkpatrick (SK) model in zero 
field, various spherical p-spin fully-connected mod- 
els in zero field, the Potts SG with p = 3 (both fully 
connected and on the Bethe lattice) and instances of 
the so-called M—p models [8] for appropriate values 
of the parameters M and p. We also expect that the 
structure of the mean-field free energy remains the 
same when the above models are defined on finite 
dimensional lattices above the upper critical dimen- 
sion D = 6. The corresponding transition has been 
also encountered in the study of schematic Mode- 
Coupling- Theory (MCT) models for supercooled liq- 
uids. In the original MCT literature it was called a 
type A transition while in the modern terminology 
is called a degenerate A 2 singularity (see [9], pag. 
228). We recall that in the context of MCT the ex- 
ponent v is usually called a. In the SG literature the 
corresponding transition is called a continuous tran- 
sition in zero external field. It has to be contrasted 
with the continuous transition in a field and with 
the discontinuous transition whose replicated Gibbs 
free energy contain additional terms with respect to 
(3) [4]. 

In this paper we will consider the correlation and 
response functions C(t, s) and R(t, s) defined as 

R(t,s) = J2Hs i (t))/Sh i (s) (6) 

i 

where the /ij(s)'s are small auxiliary time-dependent 
external fields that enters in the Hamiltonian as 
Sihi(s) and are set to zero after taking the deriva- 
tive. We will discuss the behavior of C(t, s) and 
R(t, s) at the critical point upon dynamical evolu- 
tion starting from random initial configurations at 



time t — 0. This is equivalent to an instantaneous 
quench from T = 00 to the critical temperature 
T = T C . We will focus on the so-called aging regime 
in which both t and s are large. 

We will first describe the spherical p-spin model 
with p = 2 which admits a full analytical solution. 
Interestingly enough, a dynamical computation for 
the SK model (reported in Appendix A) shows that 
the off-equilibrium dynamical exponents of these two 
models are the same. Guided by these findings, we 
will argue that for all models that have a replicated 
Gibbs free energy with the above structure (Eq. (3)) 
the correlation and response functions in the aging 
regime are described by appropriate scaling functions 
from which various dynamical exponents can be ex- 
tracted. Remarkably the scaling functions depend on 
the details of the model only through the very same 
parameter exponent A = w 2 /wi that controls critical 
equilibrium dynamics. 

Technically speaking, the above replicated action 
describes continuous SG transitions characterized by 
the simultaneous vanishing of the replicon, longi- 
tudinal and anomalous eigenvalues. The case in 
which only the replicon eigenvalue vanishes requires 
some non-trivial modifications and is left for fu- 
ture work. More physically, we note that action 
(3) is a special case of a more general action that 
should contain at the quadratic level also terms of 
the form m 2 Y, a bc QacQab and m 3 J^abcd QabQcd [4]. 
The coefficients of these terms vanish if the Hamilto- 
nian of the model display additional symmetries (be- 
sides replica-symmetry), for instance time-reversal 
for Ising spins or the Potts symmetry for spins with 
p-states. Therefore an important case which cannot 
be described by the present theory is the SK model 
in a field. 

The theory yields equations from which in prin- 
ciple the scaling functions can be computed for any 
value of the parameter exponent A. At present we 
have no analytical solution of the equations for gen- 
eral values of A but we have devised an approxima- 
tion scheme that yields consistent estimates of the 
scaling functions and exponents for not too large val- 
ues of A. 

Novel predictions for the approach to equilibrium 
of one-time quantities can also be obtained, notably 
the energy and magnetization decay that are typi- 
cal quantities measured in numerical simulations. It 
is found that the energy approaches its equilibrium 
value at infinite time according to: 

E{t) - E x cx (7) 
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meaning that the dynamical exponent of the off- 
equilibrium decay of the energy is two times the 
exponent of the equilibrium correlation v. The de- 
cay of the remanent magnetization or equivalcntly 
the decay to zero of the correlation between the ini- 
tial random configuration and the configuration at a 
large time t is given by: 

m R {t) cx C(0,t) cx i . (8) 

According to the theory, the exponent 5 obeys the 
following relationship 

5 = a + v (9) 

where a is a novel exponent associated to the be- 
haviour at small argument of the scaling functions 
for the correlation and response. Specializing to the 
Sherrington-Kirkpatrick model in zero external field 
the theory yields v = 1/2 and a = 3/4 leading to a 
1/t decay of the energy and to an exponent (5 = 5/4 
consistently with a previous direct analisys and nu- 
merical simulations [20]. 

The predictions of the theory have been validated 
in two ways. We considered the 2 + 3 class of spher- 
ical Spin-Glass models where the parameter A can 
be tuned between and 1 and solved the exact 
off-equilibrium dynamical equations by means of a 
power series expansion at small times. The method 
allows to control precisely the region of moderately 
small values of A where the decay exponents are not 
too small. In this region we have found a very good 
agreement with the results coming from the numeri- 
cal solution of the universal equations [24] . We have 
also performed a numerical simulation on the fully 
connected three-states Potts Spin-Glass at the crit- 
ical temperature. In this case A = 1/2 and we have 
again found a very satisfying agreement with the 
predictions of the theory for the decay of the energy 
and for the various dynamical exponents obtained 
from the numerical solutions of the universal equa- 
tions. 

The paper is organized as follows. In section 
II we will present the general scenario for the off- 
equilibrium critical behavior of the class of systems 
considered. In section III we will give a detailed 
treatment of the off-equilibrium dynamics of the 
spherical 2-spin model showing explicitly that it fol- 
lows the general scenario. In section IV we will 
study off-equilibrium dynamics in the quasi-static 
limit and argue that the above scenario applies to 
all systems whose replicated Gibbs free energy ad- 
mits the expansion (3) following the procedure of 



[4]. In Section V we will present a method to solve 
numerically the universal equations describing the 
correlation and response function and give the result 
of this analysis. In Section VI we will validate the 
theory presenting results from an off-equilibrium nu- 
merical simulation on the three-states Potts SG and 
on the solutions of the exact dynamical equations 
for the spherical models. In Section VII we will give 
our conclusions. Various computations and results 
will be presented in the appendices. 

II. THE GENERAL SCENARIO 

We consider a general scenario in which off- 
equilibrium critical dynamics can be characterized 
by the following three regimes depending on the 
value of t and of r = t — s: 

• The equilibrium regime corresponding to t 3> 
1 while \t— s\ <C t. In this regime the two func- 
tions become equal to their equilibrium limit: 

C(t,s)^C eq (t-s) 
R(t,s)nR eq (t-s) (10) 
for t » 1 , \t - s\ -C t 

the precise form of the function C eq (r) at small 
time differences r depends on the microscopic 
details of the model and of the type of dynam- 
ics. However as we said before the exponent 
v of the long time power-law decay at critical- 
ity depends only on the parameter A = wijwx 
through Eq. (4). 

• The aging regime in which t 3> 1 and r is also 
large such that s/t — a remains finite while t 
tends to infinity. Recall that in the present pa- 
per we are considering the aging regime at the 
critical temperature while for a study of the 
aging dynamics below the critical temperature 
we refer the reader to [1, 2, 10]. 

In this regime we have: 

C(t,at) = ^C{a)+o(t- v ) (11) 

R(t,at) = -^K(a) + ait-- 1 ) (12) 

where the exponent v is the same of the equi- 
librium regime and c is a model-dependent 
constant prefactor. 

The two scaling functions C(a) and lZ(a) arc 
determined by two quadratic equations that 



4 



depend solely on A. In order to write the equa- 
tions it is convenient to define: 



lZ(a) in the limit a — > 1 matches the equilib- 
rium behaviour and we have: 



C eq (a) 

lZ eq (a) 



1 



1/(1 - a) v 
1 



(13) 
(14) 



(1 - «)"+! 

The behaviour of the two functions C(a) and 



C(a) 
11(a) 



a— >1 



^> C e9 (a) 



(15) 
(16) 



The equations for C(a) and lZ(a) read: 



and 



C(b)a- / - 1 n [-)- C(a)a-' , - 1 K, 



- C{a)a- v C eq {Q) - C(a)C eq {a) + / \ll(b)b- v C (?) - lZ eq (b)C(a)] db + XC 2 (a) = 

(^) - 11(a) [lZ eq (b) + K eq (I)] } d6- 
- 2"K(a)C e(? (a) + 2A"K(a)C(a) = 

I 



In the case A 
equations is: 

C(a) = 
11(a) = 



the solution of the above 



this case we have: 



4a 3 / 4 



(l + a)(l-o)V2 



(1 - a) 3 / 2 



(17) 
(18) 



The above solution correspond to the spheri- 
cal model with p = 2, in this case C(t, at) and 
R(t, at) can be computed explicitly and the 
constant c turns out to be equal to l/(2n 1 ^ 2 ). 
For general values of A we cannot exhibit ex- 
plicitly the solution of the above equations. 
However we expect that the two solutions at 
small values of a have a power law behaviour 
controlled by a single exponent a according to: 



C(a) cx a c 
11(a) cx a c 







(19) 
(20) 



The regime in which t > 1 while s is finite. In 



C(t,s)~ ¥ c(s) 
R(t,s)~^r(s) 



(21) 
(22) 



Similarly to the equilibrium case, the precise 
form of the two functions c(s) and r(s) at finite 
s depends on the details of the model. How- 
ever, by means of matching arguments, their 
large- s behavior and the value of the exponent 
5 can be inferred from the small a behaviour 
of the functions C(a) and IZ(a) of the aging 
regime and therefore are fixed by the parame- 
ter A. More precisely we expect that 

(23) 
(24) 

(25) 



and 



c(s) oc s a , s > 1 
r(s) cx s"" 1 , s > 1 



S = a + v 



The exponent b is the same of the long time power- 
law decay of the remanent magnetization 



m 



(*) 



/' 

Jo 



R(t, s) ds 



(26) 
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for finite waiting times t w . In fact it is straightfor- 
ward that for t >• 1 and t w /t <C 1 



m R (t) oc R(t,0) 



(27) 



Since our interest will be in the asymptotics and, 
in particular, in the exponent 5, we will make no 
distinction between the two quantities and we will 
simply refer to R{t, 0) as the "remanent magnetiza- 
tion" throughout the paper. 

We will also obtain a general prediction on the off- 
equilibrium behavior of the energy. The form of the 
Replicated Gibbs free energy (3) tells us that devi- 
ations of the energy from its equilibrium value are 
controlled in replica space by the quantity ^ a b Q 2 ab , 
from this one can argue that in off-equilibrium dy- 
namics the energy approaches its equilibrium value 
in the following way: 



E(t) ^E 00 + 



t 2u 



(28) 



meaning that the energy has a power-law relaxation 
to equilibrium with an exponent two times v. The 
coefficient can be expressed in terms of the model 
dependent constants clt and c and by means of the 
functions C{a) and TZ(a) as: 



&e{v) — clt <? 



f [C{a)n{a) 
Jo 



Z eq {a)n eq (a) 



1 

(29) 



The most interesting features of the present sce- 
nario is that many of the dynamical off-equilibrium 
critical exponents are determined by the very same 
exponent parameter A controlling the equilibrium 
dynamics. In particular the exponents a and 5 
(through 5 = a + v) are both determined by the 
universal aging-regime equations for C(a) and lZ(a). 
This type of equations is not well studied in the 
literature and it is not clear to us if it is possible 
to find an explicit analytical solution when A =/= 0. 
Due to the singular nature of the solutions it is also 
not simple to solve them numerically, nevertheless in 
Section V we will present a variational scheme that 
appears to give consistent results. The method uses 
appropriate trial functions for C(a) and lZ(a) which 
are fixed minimizing the square of the deviations of 
the exact equations on a set of points between zero 
and one. The procedure requires that the integral 
equations are recast in order to render the singular- 
ities in the numerical integrals harmless. Once this 
is achieved integrating by parts, a standard Gauss- 
Newton minimization scheme appears to converge 



rather fast. In this respect we believe that the prob- 
lem at the numerical level is essentially solved: hav- 
ing more precise results than those we will present is 
only a matter of computational time and numerical 
precision. 



III. SPHERICAL 2-SPIN MODEL 

The off-equilibrium dynamics of the fully- 
connected spherical 2-spin model [11, 12], has been 
solved exactly below the critical temperature in [13] 
through a projection on the eigenvalues of the (ran- 
dom) interaction matrix. 

In this Section we study the off-equilibrium dy- 
namics at the critical temperature starting from a 
random configuration at time zero and, in particu- 
lar, the asymptotic long time behaviour. We will 
basically follow the approach and the notation of 
[14]. Here we give the main results, while the details 
of the computation can be found in Appendix B. 
The Hamiltonian of the model is given by 



- 2 JijSiSj 

i¥=0 



(30) 



where the spins are continuous variables satisfying a 
global spherical constraint 



(31) 



and the couplings arc independent random variables 
following a Gaussian distribution with zero mean 

p{J " )= iht^{- N Pj (32) 

It can be shown [14] that the eigenvalue density dis- 
tribution of the random interaction matrix follows 
the well know Wigner semi-circle law in the thermo- 
dynamic limit and is sample independent at leading 
order, namely 

P(P) = ^v/4J 2 -M 2 H < 2J (33) 

The critical temperature of the model is given by 
[14] 



1 



2J j 
2.7 IJ — H 



(34) 



G 



As already pointed out, the projected Langevin 
equation corresponding to this system can be solved 
exactly and the correlation and the response func- 
tions can be expressed in terms of a function j(t) in 
the following way 



C(t,s) 



+ 2T 



f dpip{p) k(0)e-( 2J -^ t+s ) 7 (t)7(s) 

J-2,7 

I 



min(i,s) 



dt l (2J-u,){t+s-2t') 7(07(5) 



/2J 
dpp(p) e -( 2 ^-M)(t- 
-2,7 



7(a) 



(35) 



(36) 



where 7 (i) satisfies the integral equation (B6) given 
in the Appendix, considering the definition (B5). 
Through an asymptotic analysis of the integral equa- 
tion (see Appendix B) it can be seen that, at the crit- 
ical temperature T = T c = 1, the laeding behaviour 
of 7 for large times is 



7 (t) ~ 2 3 /V/ 4 i 1 /4 



(37) 



It has been shown in [15] that in the low temper- 
ature phase (T < T c ) and for large waiting times s 
(or t w ), three different time-scales can be identified: 
two time-scales are more evident and were already 
discussed in [13] while the third one is more subtle. 

The first regime is the equilibrium one where s — > 
00, t/s = (t - s)/s « 1, in which FDT holds. The 
second regime is the aging one, where s — > 00 and 
r cx s and the scaling variable becomes the ratio t/s. 

The third time-scale is intermediate and corre- 
sponds (below T c ) to the plateau preceding the 
aging part. This time-scale is a function of the 
waiting time and, more precisely, it corresponds to 



4/5 



« s (see [15] for the details). 



T ~ S 

As we will see, this third time-scale is absent at 
the critical temperature, basically because there is 
no plateau in the correlation. 

We consider now the system at criticality (T = 
T c ) and we introduce two scaling functions in the 
regime where t, s — > 00 with s/t — a (aging regime). 
From Eq.s (35) and (36), considering the asymptotic 
behavior of j(t) we obtain 



C(t,at) 



2a 3 / 4 



7^/2(1 + a )(l_ a )l/2/;l/2 



R(t, at) 



-1/4 



2^/2(1 _ a )3/2 t 3/2 



(38) 



(39) 



From Eq. (38) it is clear that this regime describes 
the correlation near its equilibrium value which is 0, 
in fact there is a prefactor i~ 1//2 ensuring that C is 
small given any t large. This is due to the fact that 
at the critical temperature there is no plateau and 
no aging, at difference with the case below T c where 
the correlation function stays close to the plateau in 
a regime r ~ t p (s) which is intermediate between 
equilibrium and aging. 

In the large time equilibrium regime we consider 
C(s + t, s) with s — y cx), t >> 1 and t/s -> 0. This 
means that we have to take first the s — > 00 limit and 
then take r very large. Discarding the corrections of 
the prefactor in t/s, the leading order gives 



C(t)^ 



1 



r l/2 T l/2 



R(t) 



1 _ dC 
2tt 1 /2 t 3/2 - ~dJ 



(40) 



(41) 



which is consistent with the fact that in this regime 
FDT must hold. 

Finally we consider a different situation, namely 
t — >• 00 and s <~ 1, and using again the long-time 
behavior of the function -f(t) we easily find 



C{t,s) ~ c(s)f 



-5/4 



R(t,s) ~r(s)t- 5 / 4 



(42) 



(43) 



with 

c(s) = 7(s) 
r(s) 



1 /8 

+ 



1/4 



(2tt)V4 VV Jo 7 2 (^') 



-dt' 



(2tt) 1 /4 7 ( s ) 



(44) 



Note that at finite s, the correlation and the response 
exhibit the same power law behavior for large t with 
different non- universal prefactors, c(s) and r(s) re- 
spectively, depending on s in a non-trivial way. Fix- 
ing s — we have instead that the two prefactors 
become exactly the same, as it should be, since the 
two functions C(t, 0) and R(t, 0) are indeed identi- 
cal, as can be seen from equations (35) and (36): 



2 j 



C{t, 0) = R(t, 0) = / dn p(ii)e-V J -> i > t 'Y(t) 

J-2J 

(45) 

So far we have computed separately the asymp- 
totic behavior of the correlation and response in 



three different regimes, starting from their closed an- 
alytic form. On the other hand, supposing that we 
knew only the scaling in the aging regime given in 
Eq.s (38) and (39), the scaling in the other regimes 
could have been derived through matching argu- 
ments. 

The long waiting time behavior of (42) and (43) must 
match the behavior of (38) and (39) close to a = 0, 
in fact 



c(s) 
r(s) 



7rV2" 
1 



,3/4 



-1/4 



(46) 



which could have been obtained from (38) and (39) 
taking the leading order for small a and then substi- 
tuting a — s/t. 

Moreover the asymptotic behavior of (40) and (41) 
must match (38) and (39) close to a = 1. Again, one 
can derive it taking the leading order in a w 1 and 
substituting t(l — a) = r. 

We found convenient to use this parameter a £ [0, 1] 
but the same results can be obtained considering the 
more common b = t/t w with & € [1, oo). In this case 
the scaling functions read 



C (bt w , t w ) ~ 



2& 1 / 4 



7Tl/2( &+ l)(6-l)l/2tV 2 



&1/4 



27rV2(6_ lym 



3/2 



(47) 



(48) 



and the matching with the finite-waiting-time 
regime is acheived for b — > oo. 

The case of the spherical 2-spin model is particu- 
larly simple and the dynamics can be solved analyt- 
ically in all details, while this is not true in general 
for models displaying a continuous transition. In the 
next section we generalize these results using an ef- 
fective field-theory approach. In particular, we show 
that, for a generic continuous model, the exponents 
of the relaxation of one-time quantities (e.g. energy 
and remanent magnetization) are ruled by the expo- 
nent parameter A. 



IV. GENERAL SYSTEMS 

In this section we argue that the scenario for 
the off-equlibrium dynamics described in Section II 
holds for any model whose replicated Gibbs free en- 
ergy admits an expansion of the form (3) near the 
critical temperature. We will basically apply the 
same arguments used in Refs. [4, 5] in an equilib- 
rium context. 

We consider a super-field formulation of dynamics 
in which one obtains a dynamical equation of state 
for the correlation and response. In the so-called 
Fast Motion (FM) limit, microscopic dynamics is 
infinitely fast and the system reaches equilibrium 
instantaneously In this limit the correlation and 
response are given by the equilibrium solution: 



Q eg ,FM(l,2) =C e ,(0)<5(l,2) 



(49) 



where 1,2 are superfield variables. Following [4] we 
argue that in the large time limit off-equilibrium 
dynamics can be described expanding the dynam- 
ical equation of state around the FM solution. This 
corresponds to the assumption that, on large time 
scales, we are essentially in a quasi-cquilibrium situ- 
ation in which all one-time quantities are near their 
equilibrium value. The same arguments of [4] lead 
to the conclusion that, in this limit, the dynamical 
equation of state reduces to the following equation 
for 6Q(1, 2) = Q(l, 2) - Q eq , FM (l, 2): 



toi J d25Q(l, 2)5Q{2, 3) + w 2 5Q{\, 3) 2 = . 



(50) 



where the coefficients w\ and w 2 are the same of the 
static replicated Gibbs free energy (3). Note that 
there are no explicit time derivatives in the above 
equation as well as in the equilibrium case. We have 
also set to zero the first order terms assuming that 
we are at the critical temperature. 

Following [4], we can rewrite the above equation 
explicitly in terms of the response and correlation 
function, we obtain the following two equations [25] : 



/' 

Jo 



R{t U t 2 )C{t 2 ,t 3 )dt 2 



dt 2 R{hM)C{t2,t 1 ) - 2C eq {0)C(t 1 ,t 3 ) 



w 2 



C{t 1 M) 2 = U (51) 



/ R{t 1 ,t 2 )R{t2M)dt 2 - 2C eq (Q)R{t 1 ,t 3 ) + 2—C(t u t 3 )R{t u t 3 ) = 
Jt 3 wi 



(52) 



r 



Similarly to what we did in the equilibrium treat- 
ment we want to get rid of the model depen- 
dent constant C eq (0), this can be done using 
Fluctuation-Dissipation Theorem e.g. C eq (0) = 



J-oo 1Le 9 

we can rewrite the equations as: 



Req{t\ , t2)dt2- By means of some manipulations 



/ R{t u t 2 )C(t 3 ,t 2 )dt 2 + f [C{t u t 2 ) - C(t 1 ,t 3 )]R(t 3 ,t 2 )dt 2 - C(t 1 ,t 3 )C eq (t 3 ,0)+ 
Jo Jo 

+ C(t!,t 3 ) f [R{t 3 ,t 2 )-R eq (t 3 ,t 2 )]dt 2 + C(h,t 3 )-C eq {t 1 ,t 3 )+ f [R{h,t 2 ) - R eq {t u t 2 )]dh 
Jo Jt 3 

+ J* 1 R(h,t 2 )[C(t 2 ,t 3 ) - c(h,t 3 )]dt 2 + - 1) c 2 (t u t 3 ) = o 



(53) 



/ [R{h,t 2 ) - R(t!,t 3 )] [R(t 2 ,t 3 ) - R{h,t 3 )]dt 2 
Jt 3 



ti 



+R{t u t 3 ) / [R(t!,t 2 ) - R eq {t u t 2 )]dt 2 + R(t u t 3 ) / [R(t 2 ,t 3 ) - R eq {t 2 ,t 3 )]dt 2 
Jt 3 Jt 3 

-2i?(i 1 ,i 3 )C e9 (t 1 ,t 3 ) - (h -t^RihM? + 2 — C{t ll t 3 )R{hM) =0 



(54) 



r 



The above equations describe the correlation and 
response in the region where both C(t\,t 2 ) and 
R(ti,t 2 ) are small. This means, in particular, that 
times must be large but also well separated. As we 
will see they were written in a form that allows to 
take the large time limit inside the integrals keeping 
the result finite. In order to proceed, we note that 
for t 3 — > ti we expect that C(ti,t 3 ) and R(ti,t 3 ) 
tend to their equilibrium value. In this limit we ex- 
pect that the above equations reduce to the critical 
equilibrium dynamical equations considered in [4]. 
The above equations were rearranged in such a way 
that the critical equilibrium equations correspond to 
last line of (53) that at criticality admits the solution 



C eq {ti,t 3 ) — 

Req(tl,t 3 ) — 



1 



v\h -tsl" 
1 



(55) 



|tl-*3|" 



+ 1 



Thus the fact that we are off-equilibrium is encoded 
by the presence of the terms in the first two lines of 



Eq. (53). If we plug the critical equilibrium solu- 
tion (55) in (53) we find that the second line gives 
trivially a vanishing contribution while the first line 
yields a term l/{tit 3 y . This term can be treated as 
a small correction to the last line which is of order 
l/|ii — t 3 \ 2lJ as long as \t\ — t 3 \ <^iti and this corre- 
sponds to the equilibrium regime. The aging regime 
corresponds instead to the case in which the two con- 
tributions are of the same order i.e. \t\ — 1 3 \ — O(ii) 
or equivalenty to the limit in which we send t\ to in- 
finity while keeping a = t 3 jt\ finite. In this limit 
both C(ti,t 3 ) and R(ti,t 3 ) go to zero and we are 
naturally led to the following ansatz: 



C(t,at) 
R(t,at) 



C(a) 



t u+l 



11(a) 



(56) 
(57) 



The scaling exponents \jt v and l/t v+1 arc fixed by 
the matching with the equilibrium behaviour which 
is obtained for a — > 1. Plugging the above ansatz 



into equations (53) and (54) we obtain the two duction: 
quadratic equations already presented in the intro- 
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Jo 



TZ(b)C - ) db + 



f 

Jo 



C{b)a-^ l n - -C{a)a- v - l K, 



db- 



/I 
n(b)b-"C (J) - K eq (b)C(a) db + XC 2 (a) = 



(58) 



and 



[n^b-^n Q - ii(a) \n eq (b) + n eq } db- 

2K(a)C eq (a) + 2XlZ{a)C(a) = 



(59) 



These equations generalize to the off-equilibrium 
case the critical equilibrium equations that corre- 
spond to the last line of Eq. (53). Therefore the 
universal scaling function 1Z (a) and C(a) are deter- 
mined (up to a model dependent constant) solely by 
the parameter A = w 2 / w i- The model-dependent 
constant cannot be determined in this framework 
and have to be fixed through a matching with the 
equilibrium soluition at small time differences. For 
A = one can check that (17) and (18) provide a 
solution of the above equations. We note that the 
above equations reduce in the limit a — > 1 to the 
equilibrium case in which the simple relationship be- 
tween A and v can be obtained. Unfortunately, it 
seems that such a simplification does not occur for 
the exponent a controlling the small a behaviour: its 
determination requires the complete solution of the 
universal equations. In the next section we will in- 
troduce a numerical method to solve the equations. 
As discussed in the section II the critical behaviour 
of the energy is controlled at leading order by the 
quadratic term in the action: 



that: 



/ 



8Q{l,2) 2 dld2 



(60) 



Note that the double integration however makes this 
term vanish [26], this corresponds to what happens 
in the Replica method due to the n — > limit be- 
cause the above term evaluate to n(n—l)q 2 . In order 
to measure the energy at a given time t\ one must 
consider a fluctuation of the temperature at that 
given time, therefore breaking the time-traslational 
invariancc of the Hamiltonian, from this it follows 



E(ti) oc J SQ(l,2fd2 



f 

Jo 



(61) 



C(t u s)R(t 1 ,s)ds- Cl(0) 



the above expression can be simplified using 
Ceg(0) = j t J 00 C eq (t l ,t 2 )R eq (t 1 ,t 2 )dt 2 and leads to 



the result quoted in section II: 



E{t) ^E 00 + 



Oe(v)_ 
t 2l/ 



(62) 



where is the model-depedent equilibrium value 
of the energy and the constant o,e(v) is given by: 



cle{v) = ar c 2 



/ \C{a)1l{a) 
Jo 



C eq (a)K eq (a) 



(63) 



V. VARIATIONAL SOLUTION OF THE 
UNIVERSAL EQUATIONS 

We want to obtain the shape of the scaling func- 
tions C(a) and IZ(a) and, in particular, their power 
law behaviour in a ~ which, through the match- 
ing arguments described in Sec. IV, determines the 
decay exponent of the remanent magnetization. 
In order to solve the equations we use a variational 
method with an objective function that is simply the 
sum of Eq.s (58) and (59) squared computed in a set 
fi of k points fi = {ai, • • • ,afe}- 
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Clearly we cannot perform the minimization of the 
objective function in the entire space of functions C 
and 1Z defined on the interval [0, 1] and we have to 
choose a trial form. A quite natural choice is the 
following 



C(a) = 



11(a) 



2a° 



v(l + a)(l - a) v 



i=l 



l + ^Tliia-l) 



(64) 



(65) 



where we take the form of the scaling functions for 
A = and multiply it by a polynomial correction of 
order O. 

In the present case this minimization procedure 
will determine the optimal value of a (that is the 
most relevant quantity) and of the parameters {Ci} 
and {TZi}. We recall that the value of the equilib- 
rium exponent v is known analytically from static 
computations [4]. 

Two observations arc in order at this point, based 
on the asymptotic analysis given in Appendix C: 

• for A 7^ the first subleading correction to the 
behaviour of the correlation and response in 
a = must necessarily be non-analytic, in the 
sense that it is some non-integer positive power 
of a that cannot be expressed as a power series. 
Despite this, we expect (and verify) that with 
our choice of the trial functions (64) and (65) 
we are able to determine accurately the leading 
behaviour of C and 71 for small a, that is given 
by the exponent a. 

• with our choice of the trial functions the equa- 
tions have a singular behaviour in a <~ and 
a <~ 1. For this reason, the equations must 
be properly re-weightcd in the objective func- 
tion to ensure that both the equations in all 
the points of f2 have approximately the same 
relevance in the minimization procedure. 

If we call £ c [a,{C},{R}] and £ R [a,{C},{K}] re- 
spectively the l.h.s. of Eq.s (58) and (59), we show 
in Appendix C that they behave as 



f c [a,{C},{^}](x a Q - 
E R [a,{C},{K}]<xa a - v - 1 
and 

£ c [a,{C},{1l}]K{l-a)- 2v 
£ R [a,{C},{7l}} a(l-a) 



for a ~ 



(66) 



for a ~ 1 

( 67 ) 



All these observations lead to the following form for 
the objective function 

Fla,{C},{K}} = 

^((w c (a)f c [a,{C},{K}]) 2 
TTn ( 68 ) 

(w R (a)£ R [a,{C},{7l}]^ 



with 



aefi 
+ 



W R (a) = a" 



L (i-«r 



We have minimized the objective function by means 
of the Gauss-Newton algorithm which is standard 
for least squares functions. Note that the a in (68) 
should be the correct a which we actually determine 
with the minimization of (68) itself. This issue is 
solved starting with a trial value of a and adjusting 
it self-consistently at each step of the Gauss-Newton 
algorithm with the value at the immediately preced- 
ing step. 

We applied the Gauss-Newton algorithm for values 
of A up to 0.55. For the trial function we choose 
O = 6 since, for polynomials of higher orders, the 
convergence of the minimization algorithm becomes 
quite slow, especially for large A. In any case, we 
observe that for low enough values of A there is no 
significant difference in the determination of the ex- 
ponent a between the case O = 6 and O = 8. The 
choice of the set of points fl is important for two 
different reasons: 

• the number of points must be grater than O, 
otherwise the objective function will have flat 
directions and the Gauss-Newton algorithm 
will not converge 

• since the trial function is only approximate, 
the choice of the set of points influences the 
final result. This dependence on f2 becomes 
stronger for larger values of A while it is almost 
irrelevant for small A. 

Another technical point is that the computation of 
the objective function requires the numerical evalua- 
tion of various definite integrals with arguments that 
are singular at the extrema of integration. There- 
fore in order to reduce the numerical errors it is 
convenient to eliminate the singularities analytically 
(trough integration by parts) before performing the 
actual numerical integration. We perform the min- 
imization for different fis, then we take the average 
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A 


a 


Err 





0.750 





0.05 


0.744 


0.002 


0.1 


0.737 


0.003 


0.15 


0.728 


0.003 


0.2 


0.718 


0.003 


0.25 


0.707 


0.003 


0.3 


0.695 


0.003 


0.35 


0.682 


0.003 


0.4 


0.667 


0.004 


0.45 


0.651 


0.005 


0.5 


0.633 


0.007 


0.55 


0.614 


0.009 



TABLE I: The exponent a determined through the 
Gauss-Newton minimization procedure. The value 

for A = has zero error since it is determined 
analytically. The other values reported in the table 
are averages over different choices for the set of 
points Q with the associated error. 

over the choices as the correct result and the square 
root of the variance as our error. The results are 
shown in Tab. I. In Fig 1 we reported the exponent 
a for three representative choices of the set of points, 
in particular 

fii = {0.01, 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 0.95} 
n 2 = {0.01, 0.05, 0.15, 0.25, 0.35, 0.45, 0.55, 0.65, 

0.75,0.85,0.95} 
Q 3 = {0.001, 0.005, 0.01, 0.03, 0.07, 0.15, 0.2, 0.25, 

0.35,0.45,0.60,0.75,0.85,0.95} 

(70) 

In Figs. 2 and 3 we show the correlation and re- 
sponse scaling functions for different values of the 
exponent parameter A and for the particular choice 
Q = Ox . The whole procedure was implemented 
within Mathcmatica using the routine N Integrate^ 
for numerical integrations. 

VI. TESTS 

In this section we present two validations of the 
theory presented above: the first one is a Monte 
Carlo study of the three colors fully-connected Potts 
model, while the second is a power series solution of 
the dynamical equations for the spherical (2+3)-spin 
model. 




FIG. 1: (Color online) The exponent a for three 
representative choices of fl. The dashed line is the 
average over these three sets Ox, ^2 and £1%. 




a 



FIG. 2: (Color online) Correlation scaling function 

for different values of the exponent parameter A 
(growing from lower curve to upper curve) and for 
the particular choice = Qi. 



A. Monte Carlo study of the 3-colors 
fully-connected Potts model 

We consider the fully-connected 3-colors Potts 
Hamiltonian 

^ = ~I>i(3<W i -l) (71) 

where the couplings are i.i.d. Gaussian random vari- 
ables with zero mean and variance 1/N. 
This system undergoes a continuous transition at the 
critical temperature T c = 1 with A = 1/2 [16, 17], 
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X = 0.05 

X =0.1 

X =0.15 

X =0.2 

X = 0.25 

X =0.3 

X = 0.35 




FIG. 3: (Color online) Response scaling function 
for different values of the exponent parameter A 
(growing from lower curve to upper curve) and for 
the particular choice f2 = fix. 



which gives an equilibrium exponent 
v = 0.3953 



(72) 



We study the system by means of an off-equilibrium 
Monte Carlo simulation starting from a random con- 
figuration and, in particular, we consider the en- 
ergy and the remanent magnetization. We simulated 
fully-connected systems of size 2 9 , 2 10 , 2 11 , 2 12 (1000 
samples) and of size 2 16 (329 samples). 

Due to finite size effects e(t) and iur display a 
power law behavior only up to a certain time-scale 
t*(N) that diverges with the size as t*(N) ~ N 1 ^ . 
Moreover, in order to have a collapse of the curves for 
different sizes we have to take into account the finite- 
size and finite-time effects, and use the rescaled vari- 
ables 



N^^m N 



(73) 



where e^r and are the energy and magnetiza- 
tion at finite size N. With the rescaled variables 
we observe an excellent collapse of the energy and 
magnetization decay, see Figs. 4 and 5. 

We perform a power-law fit on the curves for the 
largest size (2 16 ) assuming for large times 



e(i)- 
m(t) 



(74) 



? 10 



N=65536 
N=4096 
N=2048 
N=1024 
N=512 
f(x) = c/x 2v 



0.01 



0.1 



t/N 



1/(3v) 



FIG. 4: Energy decay towards its equilibrium value 
for different sytstem sizes. The rescaled curves 
display an excellent collapse, and a nonlinear fit 
with x~ T gives an exponent T = 0.777 ± 0.010 



1000 



100 



10 



N=65536 
N=4096 

t N=2048 
\ N=1024 
V N=512 
V f(x) = c/x v+a 



0.01 



0.1 

t/N 1/ < 3v > 



FIG. 5: Magnetization decay towards zero for 
different system sizes. The rescaled curves display 
an excellent collapse, and a nonlinear fit with x~ s 
gives an exponent 5 — 1.025 ± 0.013 



and we obtain 



T 



-- 0.777 ±0.010 
1.025 ±0.013 



(75) 



where mc stands for Monte Carlo. Considering that 
we know the exact value of the equilibrium exponent 
v = 0.395 • • • , we can compute the theoretical value 
of T, that is T t ^ = 0.790. If compared with the 
Monte Carlo estimate we can see that the agreement 
is good (within 2a). 

Now, in order to give our Monte Carlo estimate of 
a we have two options: 



a^l = S mc - T mc /2 = 0.633 ± 0.018 



(76) 
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or 



a<£l = 5 mc -v = 0.630 ± 0.013 (77) 

In both the cases there is complete agreement, 
within the error, with our theoretical estimate ctth — 
0.633 ±0.007. 



and the couplings are uncorrelated Gaussian vari- 
ables with zero mean and variance 



(J(P))2 



(80) 



B. Power series solution of the exact equations 
for the spherical (2 + 3)-spin model 



We consider the Hamiltonian 



7 (p) s- 



(78) 



V il<t2<---<i 



If we define fi p = J 2 and the function 



= £/V 



(81) 



where the Sj are continuous spins subject to a global 
spherical constraint 



N 

£• 

i=l 



TV 



(79) 



the dynamical equations can be written in the fol- 
lowing way 



ti(t) = T+l [ dsR(t,s)&[C(t,s)] + l f dsC{t,s)R{t,s)$"[C(t,s)] 
2 Jo 2 J Q 

dR W> = -^{t)R(t,t') + \ [ ds&'[C(t,s)]R{t,s)R(s,t') 

2 Jt' 



dt 



(82) 



= - t ,( t )C(t,t')+ 1 -J* d s ^[C(t, s )}R(t', s )+ 1 -j\ s ^"[C(t, s )]R(t, s )C( S ,t' 



We are interested in the specific case of the spherical (2 + 3)-spin model where the equations become 
st r aight f or wardly 



/*(*) 

dR{t,t') 
dt 

dC{t,t') 
dt 



= T + 2^2 / dsR(t,s)C{t,s) + ^ 3 / dsR(t,s)C 2 (t,s) 
Jo 2 j 

= -ii{t)R{t,t')+ H2 J ds R(t, s)R(s,t') + 3n 3 J dsC(t,s)R(t,s)R(s,t') 

= -fi(t)C(t,t') + H2 [ dsC(t,s)R(t',s) + ln 3 [ dsC 2 (t,s)R(t',s) 
Jo 2 J 

+ 1^2 [ dsR(t,s)C(s,t')+3n 3 [ dsC(t,s)R(t,s)C(s,t , ) 
Jo Jo 



(83) 



In this case, as well as in the case of the spherical 
2-spin model, we can see that C(t, 0) = R(t, 0) since 



they satisfy the very same equation, namely 
dR(t,0) 



dt 



= -n(t)R(t,0) 



+ 



fi 2 f dsR(t,s)R(s,0) (84) 
Jo 



3^*3 / ds R{t, syR(s, 0) 
Jo 
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where we have already considered the equality of 
correlation and response. 

We are able to solve Eq.s (83) in power series of the 
two times t and t' starting at to = 0- The resulting 
(truncated) asymptotic series can be resummed us- 
ing Pade approximants. It can be shown easily from 
static computations [18, 19] that the above model 
corresponds to our universal equations (58) and (59) 
with 



In particular we choose ^2 = 1 and [13 = 1/6 yielding 
A = \ (86) 

We computed the series to 163 orders and resummed 
it with Pade approximants of order (80,80), the re- 
sults are shown in Figs. 6 and 7 respectively for the 
energy and for the remanent magnetization. In this 
case we are not actually able to determine an error 
on the measure of the exponents since our points are 
exact. The source of the error in the determination 
of v and a is only the fact that with the resummed 
series we are not able to converge at very large times. 
For this reason we may be quite far from the true 
asymptotic power- law regime. Despite this fact, as 
we will see, the results are in reasonably good agree- 
ment with our predictions. 

Fitting the results with a power law for t G [10, 20] 
we get 

T ps = 0.914 ±0.010 (87) 

and 

S ps = 1.167 ±0.010 (88) 

where the error is roughly estimated considering 
that, choosing different time intrvals for the fit, we 
get slightly different results. The exact value of 
the equilibrium exponent is v = .455073 and the 
estimate from the power series solution is v ps = 
0.457 ± 0.005. 

As in the preceding case, in order to give our 
power series estimate of a we have two options: 

= S ps - T ps /2 = 0.710 ± 0.015 (89) 

or 

af) =5 ps -v = 0.712 ± 0.010 (90) 

we predict from our theoretical analysis ctth — 
0.707 ± 0.003. As already said, these values are in 



0.1 - 



0.01 - 




FIG. 6: Energy decay from the power series 
solution of the exact equation for the spherical 
(2 + 3)-spin model. The nonlinear fit gives an 
exponent T ps = 0.914. 



good agreement with the results from the series ex- 
pansion despite the difficulty of the measure. 

In the introduction we pointed out that action (3) 
and all the results we derived from it can be applied 
provided the Hamiltonian possess some additional 
symmetries, e.g. time-reversal in magnetic systems. 
From this it follows that in general a Hamiltonian 
like (78) with non-vanishing odd-p terms cannot be 
mapped into action (3). In the present section we 
could successfully apply the theory to the 2 + 3 case 
because the model is defined on a fully-connected 
lattice and the effect of breaking time reversal van- 
ishes in the thermodynamic limit. For the same rea- 
son it follows that the present theory applies also to 
the same models with odd-p interactions defined on 
random lattices, but not on lattices in finite dimen- 
sion. 



VII. CONCLUSIONS 

We have formulated a general scenario for the 
off-equilibrium critical behavior of a class of glassy 
systems characterized by a specific structure of the 
replicated Gibbs free energy. 

The off-equilibrium correlation and response func- 
tions obey a precise scaling form in the aging regime. 
The structure of the equilibrium replicated Gibbs 
free energy fixes the corresponding off- equilibrium 
scaling functions implicitly through two functional 
equations. The details of the model enter these equa- 
tions only through the ratio 102/101 of the cubic co- 
efficients (proper vertexes) of the replicated Gibbs 
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FIG. 7: Magnetization decay from the power series 
solution of the exact equation for the spherical 
(2 + 3)-spin model. The nonlinear fit gives an 
exponent S ps — 1.167. 



free energy. Therefore the scaling functions and ex- 
ponents are controlled by the very same parameter 
exponent A = W2/w\ that determines equilibrium 
dynamics according to [4] . 

The dynamical exponent T describing the ap- 
proach to equilibrium of the energy turns out to 
be T = 2v where v is the dynamical exponent of 
the decay of the equilibrium correlation at criti- 
cality that obeys the well-known relationship A = 
r 2 (l — v)/T{l — 1v). The dynamical exponent asso- 
ciated to the decay of the remanent magnetization 
is determined by 5 = a + v where a is the exponent 
associated to the behavior of the scaling functions 
at small arguments. 

The off-equilibrium universal equations are a gen- 
eralization of the scale-invariant equations obtained 
at equilibrium. We have exhibited the analytical so- 
lution for A = but no analytical solution is known 
for general values of A. Finding approximate solu- 
tions is not at all trivial because the scaling functions 
are singular at the extrema. Nevertheless we have 
devised an approximation scheme that appears to 
yield consistent results at least for not too large val- 
ues of A. The theory have been validated by means of 
i) exact analytical computation in the spherical SK 
model, ii) large-time analytical computation in the 
SK model, iii) numerical simulations in the three- 
states Potts glass and iv) small-time power-series 
solution of the full dynamical equations in multi-p- 
spin spherical models that also correspond to some 
schematic MCT models. 

In summary, the main result of the present paper 
is that the equilibrium replicated Gibbs free energy 



determines off-equilibrium critical dynamics at large 
times both qualitatively (through its structure) and 
quantitatively (through the actual value of the cu- 
bic proper vertexes). We expect that similar results 
hold for other types of transition as well. In partic- 
ular it would be interesting to extend this analysis 
to the continuous SG transition in a field and to 
the discontinuous SG transition, that corresponds 
within MCT to the standard liquid-glass transition 
(generic A 2 singularity). 
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Appendix A: Critical approach to equilibrium in 
the SK model at the critical temperature. 

The Hamiltonian reads 

H[a] = - ^ Ji,kOiPk ■ (Al) 

i.k 

with <7j = ±1. In order to write down exact equa- 
tions we avoid to consider Monte Carlo dynamics or 
continuous time dynamics: exact dynamical equa- 
tions can be written, but they are not so simple. We 
consider a generalized model where the Hamiltonian 
is given by: 

H P [a, t] = -~y] Ji,k0iTk ■ (A2) 

i,k 

It has been shown that (as far as the free energy is 
concerned) this Hamiltonian has the same equilib- 
rium properties of the usual SK Hamiltonian, where 
Tj = (Ti- A sequential update of this Hamiltonian 
corresponds to two steps of parallel update in the 
SK model, where the a are the spin at even time 
and the r are the spins at odd time. 

The dynamics that we are considering is therefore 
parallel update of the spins for the SK model using 
a local heath bath dynamics, i.e the spins at time 
(t + 1) have a probability distribution given by 

P t+1 [a(t + 1)} cxexp \P^J l ,k<T l {t + l)(J k {t) . 
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With this equation of motion, we can write exact 
recursion equations. For example for the magneti- 
zation we have 

m i (i+l)=tanh^/3^J iife <T fe (^ . (A4) 

In order to compute the time evolution we write 
P t [a]ocexp(-/3H t [a}) (A5) 

We have that 

H t [a] =H[a]+AH t [a] (A6) 

where for large time A_ff t [<r] must go to zero. 

We suppose that for large times AH t [a] has a sim- 
ple expression: i.e. 



AH t [a] = J2h i (t)a i . 



(A7) 



Two (and more) spins interactions are assumed to 
give higher order corrections. The consistency of 
this approximation can be checked by considering 
the perturbative effect of a possible term in AH t [<r] 
proportional to J2i,k Ri,k{ t ) a i a k- 

If we stay in the situation where there is no replica 
symmetry breaking for the Hamiltonian H t , we have 
that the computation of the r.h.s. of equation (A4) 
is easy and the computation is the same of the one 
of the cavity approximation. We finally get 



m l {t + 1) = tanh (j3 ^ Ji,k m k{t) 

k 

-f3 2 (l-q(t)) mi (t)) 



where 



q(t) = l/Nj2^(t) 2 



(A8) 



(A9) 



At large times, where rrn(t + 1) has a smooth de- 
pendence on the integer value time t, we can use for 
simplicity a continuous time t and write 



d rrii (t) 
dt 



tanh J iM m k{t) 



(A10) 



^(l-q(t))m i (t))-m i (t) 



We can now use the spectral properties of the ma- 
trix following [20] with similar results. 

We study the problem at the critical point where 
= 1, 



dm x {t) 
dt 



= -(X + q(t))m x (t) (All) 



where m\ (t) is the projection of the magnetization 
on the eigenvector of J with eigenvalue 2 — A (0 < 
A < 4). Consequently we have 



m x (t) oc r x exp(-/3Xt + I(t)) 

where I(t) = j*q(t). 
Now if q(t) behaves as 



(A12) 



(A14) 



q{t)=a/t + o(r 1 ) (A13) 
we have I(t) cx t a . On the other hand 

q(t) = J dn{\)m x {t) 2 

,4 

oc / d\V\t 2a exp(-0At) oc t - a/2+2c 
Jo 

The only consistent solution is a = 1/4. 
One finds that 

m x {t) oc r x t 1/4 exp(-^At) , (A15) 

Finally m r (t) oc i~ 5 / 4 and q(t) oc t^ 1 

Now we want to study the behaviour of the energy 

and we should be precise with the definitions. Two 

are possible choices: 

(a) H[a(t)] 

(b) H P [a(t),a(t)] 

We consider here case (a). Here we have to com- 
pute l/2(<7i(t)<7k(t)Ji^k)t- The computation should 
be done with some care, because there is a small 
correlation between the two spins, that is given by 
t, where (...) c is the connected expec- 
tation value. We finally obtain 



NE(t) = ±(via k ) t J iik - N l -P{l - q(t)) 2 (A16) 

while the first term decays as 1/t 2 the second term 
gives the leading contribution to 

E{t) = -1/2 + q(t) w -1/2 + at- 1 (A17) 

The same results are obtained considering definition 
(b). 



Appendix B: Solution of the spherical 2-spin 
model 



The Langcvin equation for the spherical 2-spin 
model can be projected on the eigenvalues of the 
interaction and reads [14] 



6 s M 
St 



= [p-z(t)]s„(t)+r ]tl (t) (Bl) 



where p G [—2 J, 2 J] is an eigenvalue of the interac- 
tion matrix, z(t) is the Lagrange multiplier enforcing 
the spherical constraint and i] is a Gaussian noise 
with 



<»?„(*)> = 

(^(t)^')) =2TS^ e S(t-t') 
Setting the initial time to — and defining 

7(t) = e 2Jt ~ti dsz(s) 
the general solution is given by 



(B2) 



(B3) 



s„(t) = Sfl (0)e 



-(2J- 



-")* 7 (t) 



7 (t) ( B4 ) 



It can be shown that a random initial condition for 
the spins Sj corresponds to a fixed uniform initial 
condition s M (0) = 1 for the projections. 
The spherical constraint with random initial condi- 
tions becomes a closed equation for 



D{t) = 



_ -iJt+2 J* dsz(s) 



7 2 (t) 

and the equation is the following 
D(t) = / dpp(p) 

J-2J 



(B5) 



2(2J-n)t 



+ 2T f dse- 2{2J -^ {t - s) D{s) 
Jo 



(B6) 



The correlation and the response can be expressed 
in terms of ~f{t) once the Lagrange multiplier z(t) is 
eliminated from the equations. 
Their form is the following (cf. Eq.s (35) and (36)) 



p2J 

C(t,t')= / dpp(p) 

J-2.J 



s 2 (0)e -(27-,)(t +t ') 7W7(O 



+ 2T 



I 



min(t,t') 



ds e 



-(2J-n)(t+t'-2s) 



7(*h(0 

7 2 (s) 
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/2J 
d/xp(/i) 
-2J 



~(2j-n)(t-t') 7(*) 
7(f) 



Given the above equations, it is clear that once 7(f) 
is determined, the correlation and the response can 
be computed straightforwardly through simple inte- 
grations. 

Taking the Laplace transform Eq. (B6) for the 
spherical constraint we obtain 



2.1 



l + 2TD(u) 



D(tt)= /_ aj 4MAl) « + 2(27-/0 



If we now define 



b(u) = 



G(u) 



1 - 2TG{u) 
we obtain G{u) in a closed form 

,2J 1 

G(u)= / dpp(p) — — 
J -2.1 u + 2{2, 



(B7) 



(B8) 



2(2J-n) 



r 2J 



= G(0)-^ [ dpp(p)x 

1 J-2J 



(B9) 



1 



{2J- p)(u + 2(2 J- p)) 

where we added and subtracted 
1 



G(0) 



2T r 



1 r 2 ' 7 

2 y_ 2J 27j 



V4 J 2 - p 2 



1 



(BIO) 



2J- p 



We need the leading behavior of G(u) at small u 
since we are interested in the long-time region of its 
Laplace anti-transform 

^^lik'^ 2 ) (BU) 
where c = (2J 3 )~ 1//2 . As a consequence, we obtain 

(B12) 



- 1 l-cT^/2 

D(it) ~ - 



2 (T c - T) + cTTcU 1 / 2 

The leading behavior of -D(w) for small u is different 
if we are at or below the critical temperature. In 
Refs. [13, 14] can be found a detailed treatment of 
the T <T C case. 

At T — T c we find at leading order 



b(u) 



1 



(2 J) 3 / 2 T 2 ' 



-1/2 



(B13) 
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Taking the inverse transform we obtain 

1 



D(t)~ 



(2J)3/ 2 T c 2 7T 1 /2 



1/2 



(B14) 



Which, setting without loss of generality J = 1 
and, consequently, T c = 1 and using definition (B5) , 
yields (cf. Eq. (37)) 

7 (t) ~ 2 3 / 4 7r 1 / 4 i 1 /4 



Appendix C: Asymptotic analysis of the 
universal equations 

We assume that the correlation and response scal- 
ing functions C(a) and 1Z(a) have a power-law be- 
haviour in a w 0, in particular 



C(a) = a a C(a) 
ft(a) = a /3 ^.(a) 



(CI) 



where C(a) and 7£(a) are non-singular in a = and 



C(o) >■ C eg (a) 

a— >1 

6(a) ^7e e9 (a) 

a— >1 



(C2) 



We can rephrase Eq. (58) in terms of the new 
tilded functions obtaining 



- db 



a~ a - v r b a+fj TZ(b)C ( b 
Jo \ a 

+a- v -> 3 - 1 f [b a C(b) - a a C{a)]tfil 
Jo 

+a a - v - 1 C{a) 



db 



+a a C(a)[a a C(a) - a-"C e ,(0) - C eq (a)} + 
+a a C(a) f [bPK(b)-Keq(b)]db 

J a 



db 



,1 

+a a / b^U(b) \b- a -"C (") -C(a) 

+ „-(^-i)d» = o 



db 



(C3) 



We now extract the leading order from each of the 
terms of the l.h.s. of the above equation 



(a"-" +1 )£(0) / dyy a+l3 C(y) + o(a p - v+1 ) 
Jo 

+(a a -')C(0) f dy (y a - \)yPU{y) + o{a a ~ v ) 
Jo 

+(a a -nC(0) [ dy [y^n{y) - K eq (y)} + o{a a - v ) 
Jo 

-(a a -»)C(0)C eq (0) + o(a a - v ) 
-(a a )C(0)C eq (0) + o(a a ) 



+(a Q )C(0) / dy y"R,(y) - K eq (y)] + o(a a ) 
Jo 



+( 



a fi - v+1 )K(0) [ 
Jo 



dyy 



a-p+v-2 



C(y)+o(a 



+(a 2a )^C(0) 2 + o(a 2a ) = 

Wi 



(C4) 

Generally speaking, the candidates to be the leading 
terms in the equation are the ones of order a — v and 
the ones of order /3 — v + 1 depending on which one 
is the smallest. 

For A = we know from the exact solution of the 
spherical 2-spin model (see Sec. Ill) that /3 = a — 1 
and, consequently, the terms are of the same order. 
Therefore the tilded functions satisfy the following 
equation 



6(0) I' dyy a+fS C(y) 
Jo 

+C(0) f dy(y a -l)yPK(y) 
Jo 



+C(0) / dy[y?ii(y)-n eq (y)} ^'^ 
Jo 

+C(0)C eq (0) 

+6(0) f dyy a -^- 2 C(y) = 
Jo 

The important point is that, if we separate the two 
terms, coming respectively from the order a — v and 
(3 — v + 1, and plug into Eq. (C5) the exact solution 
for A — we find 

4 1} =C(0) f dy{y a -l)y !3 il(y) 
Jo 

+C(0) / dy[y^TZ(y)-n eq (y)} lVb) 



+C(0)C eq (0) ? 
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and 



4 2) ee^(O) f dyy a+ ' 3 C(y) 
Jo 



! (C7) 

+£(0) / dyy a -^- 2 C(y)^0 
Jo 

If we reasonably assume that C and 7\L change con- 
tinuously form A = to A 7^ 0, we know that in a 
certain neighborhood of A = the true scaling func- 
tions would yield £^ ^ and £^ ^ so that the 
two equations cannot be satisfied separately and are 
necessarily of the same order. From this analysis we 
conclude that, independently of the value of A, the 
two exponents satisfy 







a 



1 



(C8) 



Given this first result, we can compute corrections 
to the leading behaviour. 

If we suppose that C and 1Z admit a regular power- 
series expansion around a = 0, namely 



C(a) = C(0) 
U(a) = K(0) 



fe=i 

oo 

l + ^7^ fe a 



k=i 



(C9) 



than, with some effort, we can find that there are 



terms of order 2a coming from the fifth and sixth 
line of Eq. (C4) that are equal in absolute value but 
opposite in sign, respectively 



TC(0)K(0) / dyy° 
Jo 



(CIO) 



yielding a cancellation. Therefore the equation at 
order 2a would simply read 



^C(O) 2 = 

Wi 



(Cll) 



that is satisfied only when X — w 2 /wi — 0, consis- 
tently with the fact that we know that Eq. (C9) is 
true for A = 0. On the other hand, for any A 7^ 0, Eq. 
(Cll) is intrinsically not satisfied, meaning that the 
hypothesis (C9) is not verified in the general case. 
For this reason our Ansatz (64) and (65) is in prin- 
ciple incorrect, but still gives a quite accurate deter- 
mination of the leading behaviour in a w that is 
encoded in the exponent a. 

For completeness we give Eq. (59) written in 
terms of the tilded functions at leading order: 



C (y 1 -* - 1) y u+a - 2 n(y) 

Jo 
Jo 



dy 



(C12) 



y a - 1 H(y)-n eq (y) dy = 
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